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Abstract. In this paper we enumerate the number of ways of selecting k objects from n ob- 
jects arrayed in a line such that no two selected ones are separated by m— 1, 2m— 1, ■ • • , pm— 1 
objects and provide three different formulas when m,p > 1 and n > pm{k — 1). Also, we 
prove that the number of ways of selecting k objects from n objects arrayed in a circle such 
that no two selected ones are separated by m — 1, 2m — 1, • • • ,pm — 1 objects is given by 
n^pj^ i!^~k'^) ) where m,p>l and n > mpk + 1. 
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1. Introduction 

In 1943, Kaplansky [6] published a recursive derivation of the number of combinations of n 
objects taken A; at a time without two selected ones being consecutive (see also Comtet [2], 
Riordan [8] and Ryser [9]). In 1981, Konvalina [7] derived the number of combinations of 
n objects taken /c at a time without two selected ones having unit separation, i.e., having 
exactly one object between them. 

Let [n] (resp. [n]) be the set of n objects rci,X2, • • • ,Xn arrayed in a line (resp. circle). Given 
a subset N of the set N of nonnegative integers, a subset A of [n] or \n] will be called A^- 
separate if any two objects in A have exactly j objects between them, then j € N. Let 
Nm = N — {m — 1, 2m — 1, • • • ,pm — 1} for any integers m,p > 1, define H^^n (resp. Q^^n) to 
be the number of A^'m-separate A;-subsets of [n] (resp. [n]). Thus, by our notation, Konvalina 
[7] considered the special case A''2 -separation of [n] and [n], Kaplansky [6j discussed the special 
case A^f -separation of [n] and [n], and obtained that 

(1.1) - e-^^("7'). 

In this paper, by combinatorial analysis together with algebraic method, we extend the above 
results to the general case of m. 



2. Some preliminary remarks 

Let n = rm + i with 1 < i < m, and let Ai, . . . , Am be a partition of [n] = {xi, X2, - ' ' ; Xn} 
into m subsets defined 

■^i — {Xi, Xm+ii ' ■ ■ ) Xrm+i}i 1 ^ ^ ^ 

— {Xi, J^ni+i) ' ■ ■ ) -^(r— l)m+i}) £ + 1 ^ i ^ ?71, 
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then put them in an array, 



Xl X-m+l ' ' ' ■^(r— l)m+Z Xj-m+l 
Xl+1 Xm+l+1 • ■ ■ X(r-l)m+l+l 

Xm X2m ' ' ' -^(r— l)m+m 

For any A;-subset B of [n], define Bi = B Ai. Note that, in the hne case, B is A'^^-separate 
if and only if each Bi is A^f -separate. From this critical observation together with (jl.ip . we 
can obtain the following result. 

Proposition 2.1. For any integers p,m > 1 and n,k > 0, 
(2.1) n-;,' = n('^^'"lf^ 

cTi{k,in) i=l * 

where \Ai\ is the cardinality of the set Ai, and ai{k,m) denotes the all nonnegative integer 
solutions of ki + k2 + • • • + k^ = k such that ki <1 -\- for z = 1, 2, . . . , m. 

In the next section, we can find the explicit formula for TC^^n, and show that when n is 
large enough (n > mp(k — 1) here), then T-C^^n is independent of the composition of n, 
i.e., I^il + 1^2! + ••• + \Am\ = n. However, in the circle case, the above decomposition 
does not work, for example, when n = 5,p = l,m = /c = 2, then [5] = {xi,X2.,--- ,3:5} 
has five AT^-separate 2-subsets, which are {xi, rc2}, {0:2, X3}, {2:3, X4}, {X4, 0:5}, {xs, xi}, while 
{x5,xi} n {xi,X3,X5} = {x5,xi} is not an A^'j'^-separate 2-subset of {xi,X3,X5}. In spite of 
this, we can derive a recurrence relation between Ti^^n and t?™n for n > mpk + 1. 

Given a A'^m-separate /c-subset B of [n], for some < j < m, there exist j elements of 
B, say Xi^,Xj2,--- ,Xj^., lying in the subset {xi,X2,--- ,Xmp}, in other words, each of which 
is respectively one of the first p objects of A^^,A(,^, ■ ■ ■ ,Ai^, then there are {"l')p' ways to 
do this. Now delete the related j{2p + 1) objects of [n], and delete the remainder p{m — j) 
elements of {xi, X2, • • • , Xmp}, then we get m object sets A[,A2,--- , A'^ in which all elements 
are arrayed in a line and there are totally n — p{m — j) —j{2p+l) = n — pm — pj — j elements. 
Note that the condition n > mpk + 1 leads to n — pm — pj — j > mp{k — j — 1), which 
makes the restricted inequality condition of (|2.1|) in Proposition 12.11 redundant. Then there 
are TC^^Zpm-pj-j ways to select the other k — j objects from A[,A2,--- , A'^. Hence, we have 

Proposition 2.2. For any integers p,m > 1, n,k > and n > mpk + 1, 

(2-2) ^p":^ = e(7)^'^ 



m,k _ \ " / \ ^q_,m,k-i 

p,n—pm~pj—j' 



Clearly, we can easily compute special values for Ti^^n and G^n , that is, 

• T~t'^,n = = for n < A;; 

• iLpjU — yp,n — -LJ 

• = Glli^n = n for n > 1; 

• T~C^'^j^i^ = for im + 1 < A; < (i + l)m, < n < imp and i > 1; 

• Q^n+k ~ ^ ^"-"^ + 1 <k < {i + l)m, < n < (i + l)mp and i > 1. 

Define HZ' n — Gp,n — for A; < or n < 0. 
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3. Main result 

In order to give explicit formulas for Ti^^n and Q^n , we need the following critical lemma. 

Lemma 3.1. Let Ai, A2, • • • , A^,/^ be any m + 1 complex numbers and A = Ai + A2 + - • ■ + Xm- 

Define 

u{k,m) i=l 
cr{k,m) «=1 

where a{k, m) denotes the all nonnegative integer solutions of ki + k2 + • ■ ■ + km = k- 
Then for all m > 1 and n,k >0, 



(3.1) n::^ix,A.-Ar.) = 

j>o V J / V ^ 



(3.2) 



^ I^A + (^ - + (^^ + + - - 1) (1 - ^)./-^ 

'm + j) /m + j - l\ /A + ^/s + 7T 



j>0 



(3.3) = ^A±i!^^(- + ^-lV^ + M^' + --l](^,_l).- 



(3.4, *-(A..A.....A„) = ^(^V^). 



Proof. First we recall the definition of the residue of a function. Let zq be any isolated 
singular point of a function /. Then there is a Laurent series f{z) = Yl'jL-oo'^ji^ ~ ^oV 
valid for < jz — zqI < R, for some positive R. The coefficient a_i of {z — zq)~^ is called the 
residue of / at zq, and is usually written Resf (for computing and properties of the residue 

z=zo 

see for example OH]). For simplicity, we write Resf instead Resf. 

Note that the generalized binomial coefficient has an integral representation, 



k J X x^~^^ ' 



which yields that 



(3.5) ^/A + mA 



X + fik\ k J X x^^^ 
Then we have 



ki+l 

1=1 ki>0 



X 1- {fi-l)yi 



yi=x(l+j/j)M 



x-^-K 



X (1 - (/i - 1)V3(X))™ 
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where ip{x) = x{l + ip{x))^. Using the Lagrange inversion formula for k > 1 with replacing 
X by ^x:^, we get that 

A + fi{m + j) f m + j — 1\ fX + fik + m — V 



n^\{Xu\2,--- Am) = 2^ ^ . jl^ )(/^-i) 

y (l-(M-l)y)— 1^ 

m + j — 2\ ( X + + m — \ 



j>0 



E IIL -t- J - ^ \ A ^ fin ^ lib - 1 \ 



Res{l -ifi- + ^x+t^k+m-iy-k-i^ 

y l-{fi-l)y 

^ /A + - 1)A: + A /A + /ifc + m - IV^ _ ^k-j _ 



Similarly, we also have 



^^,a(^1'^2,--- ,A^) = Res-jr^[[}^x 'Res . 



Res 



1=1 ki>0 



_ A / A + fik^ 
X + fik\ k 

This completes the proof. □ 
Remark 3.2. Note that Hwang and Wei [5] considered the special case 

n_l^^^{ni + l,--- ,nm + l) = 2^111 ^. I, 

a(k,m)i=l ^ * ^ 

OTi/i n = Til + 71-2 + ••• + nm and obtained its another expression by recurrence relation, 

r,m,k ( , . , T N sr^ (m + j - 2\(n + l-k-2j\ 

^^_i,„+„(ni + l,--- ,n„ + l) = 2^(^ . j, 

which can be derived easily from the proof of Lemma \3.1\ if one notices that 

^/so, ^/le equation (|3.4p is a generalization of Gould's identity [T'i'2], t/iat is, 

a /a + c/c\ 6 /^^ "I" "^(^ ~^)\ a + 6 / a + b + ck 

^— ^ a + cA;\ A; + c(n — n — k J a + b + ck\ k 

Then can be proved again by repeatedly using Gould's identity. 

Notice that when n > pm{k — 1) in (j2.ip . then the inequality condition for ai{k,m) (i.e., 
h < 1 + ^^) is redundant. Hence, setting Aj = fj, = —p in (|3.1|) - (|3.3|) . and combining 

with Proposition 12. H we obtain our main result. 
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Theorem 3.3. Let p,m,k > 1 be any integers. For n > pm{k — 1), 
n,m,k ^ fm + j -2\fn + mp + m-pk-l\ • 

E/n + mp - (p + l)k + j\ /n + mp + m - pk - 1\ . 

En — pjfm + j — 1\ fn + mp + m — pk — 1\ , 



m,k n fn-pk 



and for n > mpk + 1, 

(^•^^ n-pk\ k 

Proof. It just needs to prove (j3.6p . For n > mpk + 1, by (12. 2p . we have 

m,k—j 

pm-pj~j 



.>o .J J" (l + (p + l)y)' 

2/ (i + (p + i)y)— 1^ l^viy 



i>o 



1 + 2/ 



y yk+i- 



n f n — pk 



n — pk\ k 

which follows by (j3.5p . □ 
The formulas (jl.ip and (j3.6p motivate the following 

Theorem 3.4. For any integers p,m,n,k >1, if n > mpk + 1, then there exists a bijection 
between the set of Nm- separate k-subsets of [n] and the set of N^- separate k-subsets of [n]. 

We fail to produce such a bijection, and find it remains a challenging open question. 
Now, we give several recurrence relations that the sequences Ti^.n and G^n satisfy. 
Theorem 3.5. Let p,m,k > 1 be any integers. For n > pm{k — 1), 

fo 7\ n_/m,k njm,k . njm,k—l 

and for n > m{pk + 1), 



m,k _ pm,k j_ pm,k-l 
'p,n—p ' 



(•^•8) yp,k = yp,n-i + y, 

(3-9) g-n' = E(-^y("y(p+^r-'K,n-pm-j^ 

and for n > mp{k — 1), 



(3.10) n-^ = V'^^ 

i>o V J / 



p,n+pm—pj—j' 
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Proof. To prove (j3.7p . let us consider A'^^-separate /c-subsets from [n] which either contain 
the first object xi or do not. In the later case, the number of such subsets is enumerated by 
T~C^^_i. In the former case, the subsets does not contain the objects Xm+i,X2m+i, ■ ■ ■ , Xpm+i 
of the set Ai as sefined in Section 2, note that the condition n > mp{k — 1) makes the 
restricted inequality condition of (|2.ip in Proposition 12.11 redundant, so such subsets are 
counted by TC^^Zp^i- Hence, (j3.7p holds. 



Using simple algebraic calculations we obtain that (j3.8p holds. 
Note that if n > m{pk + 1), there holds 

[I + xY'P^-^{l + {p + l)x) 



yp,n 



(1 _^ 2,)n+m-pfc-l p 



Res- -, ^ — ^ p + 1 X 

X (1 + (p+ 1 + 



-fc-i 



n _|_ ^\n+m-pk-j-l 



j>0 

/m,k 



j>0 

and if n > mp{k — 1), there holds 

^^ _i_ r,,\n+pm+m—pk—l 

K'n = , , x-^~' 

P'" X (1 + + 

_ ^ (1 + a;)"+pm-pfc-l(l + (p + l)x) / px 
X X^^^ V 1 + X 



X 



rk-j + l 



j>0 

^ I ■ ji^ ^p,n+pm-pj-j^ 

j>0 \ J / 

which prove (f3^ and (f3?T0l) . □ 

The above theorem suggests that there should exist combinatorial proofs for (|3.8p . (|3.9p and 
()3.10p . However, we fail to produce such proofs, and find them remain challenging open 
questions. 
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